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ABSTRACT 

Described is the Follow Through academic program 
based on the principles and materials (DISTAR) of S. Engelmann and i. 
Becker, and reported are results of program use over a U-year period 
with 9,152 primary grade children (78 percent economically 
disadvantaged) . The program description includes teaching procedures; 
program objectives; class schedules; staffing requirements; 
principles of class management; descriptions of the DISTAR reading, 
arithmetic, and language programs; the parent role; teacher training 
strategies; and the use of biweekly reports and continuous progress 
tests as monitoring procedures. Results of testing are given 
separately for the disadvantaged students and the entire group. 
Compared with national norms is achievement of Ss on the Wide Range 
Achievement Test in reading, spelling, and arithmetic; the 
netropolitan Achievement Test (MAT) ; and the Slossen Intelligence 
Scale. Among results given are reading achievement by poor children 
starting the program in kindergarten at the 5.2 grade level by the 
end of third grade, average gain per grade in arithmetic of 1.02 
grade levels, a gain of 9.6 IQ points during the kindergarten year 
which was maintained through the primary grades, and grade level ov 
above performance on all HAT tests except reading comprehension by 
the end of grade 3. Also described are the teacher training format 
and attempts to correlate teacher performance with child performance. 
(DB) 
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Part I: Proaran Description 



Definition of kpr*rkSOTH Arpr oach 

A, Philoaonhic Foundations 

The Fnqelmann-Becker Model focuses strongly on acad^iic objectives. 
The program is premised on the belief that every child can achieve 
well in the academic arena if he receives adcKjuate instmction. 
The instruction has to be designed to begin with the skills the 
children bring to school and to build on them at a faster rate than 
would occur in a more traditional settina. The disadvantaged child 
is usually behind in relevant skills at the beginning of kindergarten 
or first grade (particularly language concepts). If he is taught at 
d "nonaal" rate, he will remain behind his middle class peers. To 
achieve a faster-than-nomial rate, procedures developed by Bereiter 
and Gngelmann for pre-school disadvantaged children have been adapted 
to a primary elementary curriculum and integrated with the basic 
principles of behavioral psychology. The procedures » 

1. reauire a far greater number of responses frcwn the child, 

2. are adjustable to individual rates of progress, 

3. use proqrajmned materials which teach essential concepts and 
operations regulred for future tasks, 

4. systematically use reinforcement principles to insure success 
for each child, 

5. utilize novel programming strategies to teach the oeneral case 
(usually called intelligent behavior) rather than focusing on 
specifics (usually called rote behavior, or rote memory"). 

The general philoaorhv of the program sponsors Is that a child who 
fails 13 a child who has not l^een taught. The remedy is to teach the 
skills which have not heen mastered. 

B. S cop e 

The sponsor will cooperat:e with the local district in providing direct 
assistance and support for the Ed'icational program, services to families 
which can foe handled by ts^rent workers, parent trainina programs re- 
latinQ to the classro<mi and to child management, and staff develooment . 
Psychological services not covered by the special training of teachers 
and aides should be provided for tbrouah consultants approved by the 
r.ponsor and the school district:. The school district Is solely respons- 
ible for health and nutritional services. It should be noted that in 
thr? area of parent training programs, the sponsor expects the local 
PAC to take the lead in procuring services from the sponsor and his 
sitaff to assist in implementation of local objectives for parents. 
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Tn the area of educational nroarams^ tho sponsor provides for tho 
core subiocts in readina, arithmetic, and languaqe. The local nro^ 
arajtn irj to provide for art^ music, P.E., social science, ethnic 
--•tudief;, spellinn, and writino in consultation with the sponsor. 
Where time conflicts arise, core suhlects must he aiven priority. 

Supplemental activities are determined partlv by sponsor 

and Partly by the <;ites» Punrlemental activities that 

firm up or reinforce the subiects beinq tauqht are specified by us. 

Additional supplemental activities are more or less local options. 
For example, we specify that after lesson 140^ all children are to 
read from readers, in addition to the reading in the small, structured 
Qroups. We do not specifv the series that is to be used; however, we 
limit the choice. For examnle, we don't allow sites to choose siqht 
reading programs. They can choose from a variety of programmed material 
and phonic series. 

Objectives 

J. By the end of the third nrade, the children in the program who 
are tauaht a full lesson on at least IfO school days each year 
will as a group exceed average national norms on an achievement 
tests in reading, arithmetic, and lanauage behavior. 

2. Reading failures will be limited to (at the most) children with 
severe physical handicaps* 

3. Tho children will learn to like school and learning. They 
will show confidence in achievementi. persi^itence in assigned 
tasks, and pride in self» 

4. The children will learn to use effectivelv the Fnglish lanauacje 
for oral communication • 

5. A «?iCTnificant percentacre of the parent communitv (20 to 35%) 
will be actively involved in the operation of the program. The 
actively involved and employed groups will be expected to change 
in attitudes about school and what the school does for their 
children. Thev will learn skills which will upgrade their economic 
and social standing. They will report changes in attitudes about 
<;elf, their school, their hones for the children ^ all in the 
direction of "things are better." "The 1ob is being done more 
effectively." They will express beliefs that something can be 
done to change schools ttnd coirenunities. 

Parents not actively involved with the program at school will be 
tauaht ways of working more effectively to support the learnina 
of their children. They will be found to use more positive rein- 
forcement. They should chanae attitudes about schools, the progress 
of their children, and hopes for the future, but to a lesser extent 
than the involved group. 
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7. The ftchoolfi or institution nhould show an increased acceptance 
of a r«al nartn«:rnh1r with j^arents, should cnAotee nore strongly 
thr u*»c of {•v'^rentr. «s teaching aides and assistants, should 
chanqe k»ellof9 ab^ut who-can-l>o-taught-what-and->!ow, should 
rc-evalua^e tta crcotamnatic objectives and procedures at all 
levels. 

Claasr o om .s^-tLinit 

When children cannot read, the primary neans available for instructincr 
them is by talking to them. To insure that more teachina ooos on, 
one teacher and tw aides are used In each class at beqinnlnoF levels 
(1 and 2). The classrooms are set up so that the three "teachers" 
are workinq in booths (for sound control) with oroups of 4 to 7 
children. The teachers and aides become fspecialists in one of the 
three basic proqrams (MTSTAR Readinq, Lancfuaqe, r^'^ ' Arithmetic) and 
a schedule is devised to fit each school's timetal - to rotate the 
children throurrh teaching groups and other activity where the 
children work on their own, or as a total group, f ••roxiraatoly 30 
Tninutes is used for small group instruction in each subject area at 
Levels 1 and 2. ^t level 3, 1!> minutes of instrv.!- ion is foUo*w»d 
bv 30 minutes of self-directed practice in workbooks which are later 
checked by the teacher. Typical schedules eould look like these: 
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1st Grade Follow Throuqh Class 
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2n» Grade 



7:30 



Green Street Elementary School 
Follow Throu<?h 
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3rd Grade 
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STORY -TIME 



NOON RECESS 
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Reading 4 
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Monday Religeous Ed. 

j Tuesday 3oc. Studies 

j Wednesday-Art 

Thursday — Soc. Studies 
3jl5l Friday Soc. studies 



Monday Religeous Ed. 

Tuesday Citizenship 

Wednesday-Firm up 
Thursday — Firm Up 
-^ ^ Friday Music 



Gr'-ups are numbered here 
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E. Staffing fteg^iiteffeni- y 

1. Lfvel 1 And ? pTO^l^n*^ tanwire one teach«»r and two aides for 
raoh clASRrct'*ift of 2S. 

2. Lt»v<»l 1 and ^ nronranir rP'inir*^ c»rip t»»achpr and one aide for 
Mch classroom •>f pxcapt that it: 1' 5 or more of the levt?l 
three children havo sabsrantially not- cc4»r>l*»ted the level two 
nrotrrams, one teach«»r and t»*o airiee should be budgeted. 

3. There should be a continuous progress tester -or wach 150 to 
aoo children ifhoae joo it iJ» to test the children on a 6 week 
cycle in each core area. 

4. There should be one video operator fot each 400 childrwi. 
(This role way be combined with "2" above.) 

0. There should be one video-data chief for each site. 

6, There should t«e a parent worker for each 100-150 children. 
Professional quidance for parent workara should be provided 
for whenever possible. 

7. There eihould Ite a locaJ teacher supervisor (who has taught in 
the program and has been trained by the sponsor) for each 200 
children. • Otherwise a sponsor consultant is required until 
local supervisors can take over. 

F. ClassroCT B Management 

The teachers and aides all "teach." They play active roles in the 
learning process for all children. The teacher is responsible, 
however, for supervision of the aides and general classroom manaqemont . 
All classroom rftrsonnnl are accountable to the principal, local suror- 
visors, the parents of vhe children, and to the sponsor for thr- 
progress of their children. It is our joint task to work together 
to insure that thf children are taught what they need to be successful 
in school and lif >*. 

Tearhing M eth<;d . The DTSTAR oroqratns are jast word-? on rnper. In 
ordeF~Lo Teach these skills, the teachers and aiJes must understand 
tho concepts and op«»r.itions they are teaching and must have a nurM>er 
of basic teaching skills- These skills involve management of the 
children and organisation of the teaching materials so that both the 
chilflron and the teacher are ready to work when they sit down in an 
instructional group. r>eyond that, the teacher needs to know how to 
teach a task — any task. Programs can be broken down into tasks. 
Tasks also have components: 
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rrf^-Tank 


Task 


Post*Task 


Get everyone's 


f^rcBont a task 


Siqnal the 


Reinforce 


attentior 


siofnai (si and 


cniiaren to 


or correct* 




teach the chil- 


respond 






dren how they 








are to respond* 






'•Listen** 


Show the letter Ri. 
"^This is iiBimDiiii.** 


^Nhat sound 
is this?- 


-Good.- 



Ff ficAont teachinor aiins at qettincf a hiqh rate of correct child 
reaponsea within the teaching time available. To accomplish this, 
the teacher needs to know the formats (tasks) in the program well* 
she needs to know how to use attention signal^, to qet the children 
to respond together (or individually) on cue« These latter signals 
we call -do it- signals f since they toll the children it*s their 
turn to -do it.- In sniall group instructionr Mo it- signals are 
critical in beinq sure each child learns idiat the teacher is teaching » 
rather than just imitating what another child is saving. The teacher 
also needs to learn how to pace each task ai^royNtiately, quickly 
enough to hold attention^ yet qoing slowly when required to give the 
children -time to think.- 

The teacher needs to learn to use reinforcers effectively to strengthen 
correct respondinci and to correct mistakes in a way v4)ich permits 
all children to learn each task (criterion teaching). For the most 
part^ teacher praise or confirmation for correct responses is all 
that is required for re. nf or cement when the teacher *s signals and 
pacinc are sharp. Occasionally, tokens or edible rewards are neiNled 
to aet the process going. Efficient correction procedures are based 
on an analysis of the kinds of errors childrm make. For elementary 
tasks, there are just three. If the child cannot make the motor 
response f the teacher leads him through it several times or breaks 
it into a simpler response and then puts it back together. If the 
child has responded to the -do it- signal with a response in the 
appropriate class, hut has the wrong response (the child says -sss- 
to m ) , he is civen the answer and the task is repeated. If the child, 
f aiTs to resnond in the riqht class (says -yes- to m) # the task is 
modeled (and often several related tasks are given) to teach him to 
respond to the siqnal which calls for a sound rather than ^yes- or 
"no." The teacher needs to learn not to pass over a mi<rtake, and to 
repeat the entire task after a correction is made so that she is sure 
her correction has been effective. With advanced tasks involvinq 
morp complex formats, the teacher needs to learn how to pinpoint the 
errr^r and present a oair of tasks selected to teach a critical dis- 
crimination* Throughout, what counts is the outcome-^ i^ether the 
children can perform the tasks being tmght. 



cESf tan RviauiBVE 



G . •Phf* S ponsor's nore iBgtructional Proci ratr. 

The core of the l-.structionAl mtoqtaB ccnsitta of procrramwS t«ach«r 
rresontatlon matf rjala in r<%ftdinT, aritrmetic, ard lantiuaqe «t three 
levels which is puMlsbed by Sctence Reeeareh Asaodatas under the 
trade name DISTAR (Direct l^rxstructional S^stcna in Arithmtic and 
Rewiiiw) • 

The act of teachiitci in»n>lvf»s cretting children to stake the riqht. 
responfte in the presence of the liqht etiantltis. When the teacher 
presents a lette/r fn and Asks, "What sound ie this?*" the children 
are to learn to reiiifiond " MwiMmttiwa i" and not w«e other reaponae* To 
achieve the theoretically aimple «3oal of qettlncy ehlldran to wake 
the right resronse in the preaence of the riqht stimalua, l»wever, 
the teacher ir.ur.t have ^eols and skill . The primarv iaol that she 
needs is an effective instructional program, whether she nakcs it 
up or uses one that is published. If used properly, this tool 
should help the teacher in the following wayss 

Tt shell provide her with exanqplas of concepts that are clear. 

It should indicate in detail how »he can phrase tasks, questions, 
and directions ao that they are clear and unaid>iquous. 

It should sequence the various skills that are to be tauofht ao 
the children proceed a step at a tine. 

It should further sequer.ce skills so that the teacher uses her 
time efficiently, by teaching more than one skill during a 
lesson. 

It should teach •*the general case** so that the children master 
qeneralized concerts and operations that can be applied to many 
situations (rather than learnino facts and idioms that apply to 
only limited situations) . 

The nisTAR programs have been designed with these considerations in 
mind. With proper training, the programs permit a paraprofesslonal 
to become an effective teacher In a relatively short period of time. 

1. Digtar Reading i and TT teach decoding and comprehension skills. 
Decoding in the rorocess of translating visually presented letters 
into specific eounds and words. Comprehension Involves knowing 
the concepts the words stand for. 

After sounds and rr«-Reading nkills such as rhymino and blending 
are presented, the children are taught to read %fords. First they 
are taught romilar words, such as sam> where nmch symbol is named 
by a single sound and each sound is continuous. The next set of 
words has a stop sound (a sound that cannot be held) first which 
makes bl«»ndlng more difficult— hat , can, tan. All words up to 
this point in the program can be sounded out, blended and said. 
Trreg\ilar worda cannot be approached in this way. Tf the word 
was were spelled by sounds* it would be wus. The children are 
taught that there are many exceptions in reading. These words 
O are caught as sneciai cases and the chUdren are taught ♦» 
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rrcorinisse them hv sirrht. The final dModinrr skill tauoht is 
t hr^ special sound that letti^r combinations make. These are also 
irrr>flrular in that they cannot be decoded by soundinq out each 
1**ttei. The sounds of ou are very different when they ap^ar 
in the word cloud than when o and u do not anoear tociether. 
:^*entence Readina romes next* First the children read the sen* 
tence with a siqnal for each wordp then they read the entire 
sentence from one sxcrnal. The teacher asks comprehension questions 
about several of th«* sentences and about the story. The story's 
content is usually novel — animal characters, exaggerations and 
surprises. More advanced comprehension skills are taught in Read 
the Ttems. For example, the children read item 4. "When the 
teacher says^ * stand up,* read Ltem 6.** Item 6 says, '•Hold up 
three yellow cards.'* The children must read each word carefully 
or they will not be able to follow the instruction. 

In Distar Readina III the children are taught to read for new 
information. The program is intended to teach children to read 
textbooks on their own and answer concept questions. Some of the 
stories are historical. Tn some cases the event is retoldr in 
other case«i two characters travel through time and experience 
life as it was lived in earlier times. Most of the stories are 
science related. The children read about scientific laws and 
then apply what they have read to exercises that follow the 
storv. They use what they have just read to figure out problems. 
Topics such as astroncmy^ muscles, roeasurment, speed and the 
atom are presented. 

The Distar Readina programs are designed to produce fluent 
accurate readers who atre able to read school text books, follow 
a variety of instructions and answer a wide range of comprehension 
miestions. 

The Distar Arithmetic progr^s are designed to teach the usual 
problem solving operations so that the children understand how 
an operation works and why they are using it. They are taught 
their arithmetic facts after they understand and can perform 
the operation. Finally, they learn the several fundamental laws 
or rules of mathematics. Arithmetic I teaches problem solving 
operations based on counting by one. In addition, thev count 
forward to the number thev start with and count forward by one 
for each number that is added. Tn 7-^2 the child counts 7 and then 
counts three more times for the plus three — 8, lo. In sub- 
traction they count forward to the number they start with and 
count backward bv one for each number that Is subtracted. In 
7-3 the child counts 7 and then counts backwards throe times 
for minus three — ^, 5, 4. Algebraic variations of addition and 
subtraction are also tauoht. The children work nrobl«ns on 
naner and on their fingers. They use both methods to solve storv 
nroMems. The equality rule oives the children a problem solving 
strateav that they can use with any of these nroblems. The rule 
i : "As manv an you count to on one side of the caual sinn, you 
must count to on the other side o^ the eoual sian.** After 
figurina out which side thev count on first in a nroblem and 
whether they add or subtract, the children are ready to solve 
the nroblem. The children are expected to m^orize 20 facts 
during the Level I program. 
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In \€Vtil ; T Ari^hwetic^ thf* children are tauqht new count InqT 
oner^itiDr.P — tn n-^uit inllcation th«v count bv numbers other than 
one nnd in frartlor?^ thev .ount oar^«< n^wb^rs le^n than one. 
They work rer,ul.ir .ttuI^ tri icatxon nroblemft (?x4 which is ortqlnally 
road an 'Tount ? four fime^/') and alqehra problems (2x ? » 8)* 
They r.Hn use a charr thexr tinqerb to vcrk the problems. In 
fractions thev learn to decode the fraction (in the fraction 2/3 
the bottom m4.^h-?v icllp that there are thrive narts in each 
;roun ano the tor niwber te'^is us that have two parts); learn 
to tell whether a fraction is lesB than one, cij^iual to one^ or 
more tfian one? and multiply fractions and reduce their answer — 
if it reduces to a whole n\imbAr, The main rule the\' are taught 
in Level II is an extension of the equality rule. The revaluing 
rule involves chancrinq how many there ^.re on one side of an 
enuatlon ^nd ther chanqinu the other side in the same way so that 
the equality relation ^reserved. When you chanqe how many you 
hnve on a side, revalue the side. The rule states: "Whatever 
vou do to rev«»lue one side of an equation^ you must do to revalue 
tnr other side of the equation. tf you have 4*4 and vou chanqe 
one side — 4«4^2. The equation is no lonqer true. You must revalue 
the other side--44?»t4^2 or 44l+l»4^2. itow the side<i are equal 
again. Usinq this rule, cho teacher can show whv the associativer 
comutative ard di:3tributiv-j laws hold. Before nresentinq the 
remalnina addition facts, the teacher shows how the facts fit 
toqeth •r-'-^that chey are not an urxelated set of statcp^ents. 
Analogies teach that sets of numbers follow rules. Fact derivation 
155 a method for f^qurinq out an unknown fact workinq from a 
known fact. You don't know what 2*5 equals ^ but you know that 
24-2 equals 4? so you count* 

2 ♦ 2 « 4 

2-^5*5 
2 ^ 4 » 6 
2 4-5 = 7 

Then the children are tauqht a few facts each day so that the 
facts are memorised. 

In Level III Arithmetic the children are tauqht three new operations 
algebra^ factor ino and division — and ^h^ traditional arithmetic 
ooorationft arc- extended. Alqebra uses the revaluing rule, for 
example, a - 7 9. To solve for a.^ you must chang:? into zero? 
you must minus seven. Tf vou minus 7 on the left,, you revalue 
the side. You *nu3t minus seven on the right, a « 9-^7. Factoring 
is the beqinniMo of division. The children count by different 
numbers in order to find nairs of factors for a number. They use 
the same algebra multiplication counting operation they were 
taught in Level II. The number is 12. When vou count by 3 you 
hit 12, so 3 is a factor of 12. When you count by 3 to 12, you 
count 4 times. 4 is the other factor. The children are taaght 
to work problems such as those below. 
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The children also use these operations in solving story problems* 

A<? new rule y»er se is not tauqht; rather how a rule or equation 
can relate a set of instances to a set of answers. In substitution 
the children are given the rule and a set of instances. They 
derive the set of answers. If the rule were a^fi = ? and a « 2^ 
then a+ft » 8; if a^l, than a*fi « 9. in analoaies the children 
i^re criven a set of instances and the set of answers. They 
derive the rule. 



Before subtraction facts are tauqht, the relation between addition 
and subtraction facts is tauqht. If 9+3»12r then 9»12*3 and 
3-12-9. Then the subtraction and multiplication facts are tauqht. 

6. In the Pi star I^anguage I program the children are taught object 
names ^ object properties, and relationships among objects. They 
are also given practice in making a wide variety of statements. 
Tome of the object properties taught are color ^ shaoe^ pattern^ 
parts, use and location. The relationships include ouality, 
comnarisons such c^s bigcrer? ouantity, only, all, some, and none? 
space, prepositions; time, before-after and first-then? condition- 
al itv, if-then and and-or; causality, whv? and multiple attributes, 
talkino about two properties or relationships at once. A picture 
shown three balls — one small and yellow, one large and blue and 
one small and blue. When the teacher says, "Show me a small blue 
ball," the child must listen to both the cOTtpatison small and the 
color bJue. If the child just attends to small, he may pick the 
^"^^^^ Y^ } }py . If the child just attends to blue, he may 

nick the larrre blue ball. 

7. In language FT object pronerties and relationships are taught — 
materials that objects are made of, new information such as 
measur^ent and the calendar, and the creative use of orior 
information, e.g., thinking up new functions for objects based 

on the rhildren's knowledge of the object's properties and 
detecting absurdities in made up objects or situations and tell 
why the picture is abstird. A nicttire might show a aolf hall 
with a large handle on it. The emphasis in Level IT is on new 
wavs r>f talking about objects and using words to talk about other 
words. The first new wav of talking about objects is an extension 
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r»f multiple a^trib-Jt**?;. Descri.pt ion rasks teach the children to 
idertifv iran>* -jorertica ox ralatior?»hlr« ^hat thev In certain 
obiocts CT ovftnt:£». ir s«/-f! r^-^kf* ih*-* f^i -,<»ct boino described is 
referred to bv * norttsense nam«. Th* childr«*n must for-us on the 
uroperties t^'> tb^*- tnov '.n fiquce out t>o object's real namn. 
In clasaif ic&tirin th:* rMidrpn crroup c'iff'?rent oble-nts or events 
accordinq to con-tson shart'i ctiTiracteristic3. Thinqs that w<» can 
eat are food. Mar. marie tninas that t&Ve us nlaces are vehicles. 
Liefinition tasks set one obj'?ct off from aii the other objects 
belnq considered. The ohie. is nlaoe<^ in the smallest possible 
class, and then characterist^.s are identified that set the object 
off from other members of the class. A car is a vehicle (the 
smAliest class) that drives down the road {sets car off from 
other vehicles such as ship or airplane) and has a trunk (sets 
car off from other vehicles that drive down the road such as a 
truck or bus.) To teach rfueationina skills » the teacher thinks 
of an object. Tho children ask questions such as, "What class is 
it in? Where do vou find it? What parts does it have? How do 
vou usR it? What is It made of?" By asking those questions the 
children can identify the object. More difficult tasks use words 
to talk about the other words. Synonyms and opposites are rules 
for relating one word to another v»ord. The synonym for hard is 
difficult. Some of the analogy rules that relate "words to each 
other follow: A word is to its synonym. An object is to a part 
of that object. An object is to how that object Is used. An 
object is to what that object is made of. An object is to where 
you find that object. 

8. Tn Distar Language III the children work from statemonta in a 
problem solving situation. They look for information that is 
provided by the statement, la the statement "The boy is smiling,** 
you know what the noy is doina, but you do not know why he is 
smiijinq or what be is wearing. After the chldren know what infor- 
mation it provide**, they c:«terinine whether the information Is 
redundant, whether tho information is relevant, and whether 
deductions bas«»d on the information are true, false or doubtful. 

Coal: A boy wantts to eat cereal and milk. 

♦statements: The bov had cereal but he could not find any milk. 
(rel<«vant) 

He wore i red shirt. (Irrelevant) 

Ft? cound not find any milk, (redundant) 

Deductions: Fo can havo nilk and cereal row. (false) 

He will r.ever eat milh and cereal. (doubtful) 
He mu^st obtain scane milk if he wants to eat milk 
and cereal now. (true) 

A second CToal of the Level HI program is to teach araramer — to 
discriminate between sentences and f racnnf»ntf5 f to if'.cntify subjects, 
verbs, and nredicates; tc wake subjects and verbs agree; to dis- 
criminate amona and nunctuate statements, ouestions and commands; 
to identify adjectives and adv«rbs. to use proper verb tenses; 
and to punctuate, capitals, commas, quotation marks, contract ions, 
abbreviations, Throuohout Level III the childrens* writino skills 
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ato developer'. The children use written statements to answer 
oueBtionSf make up storie5=i^ and describe events or objects. 

Trans i tional Programs 

When children have completed the three levels of the program the 
project manager, m cooperation with the on-site supervisors and 
the director f initiates instruction in the testbook series that 
the children will be uftimg the following year {or the 4th grade) 
in the schools^ and specifies activities and formats that should 
be used to supplement the instruction so that the children will 
transition smoothly and retain the skills taught in the three 
levels of the OISTAR programs. The children who have completed 
the level 3 program start on the second or third grade of the 
basal series they will use. The decision is based on 
nature of the series and its difficulty and the f Ixmness of the 
the children. 

A different type of transition is used for those children who 
have not conqpleted the third level of the program before the end 
of their third grade year. These children work on a specified 
variation of the E.B. program (a shortened version with some of 
the activities presented to the entire class rather than to small 
groups). In January or February, they also begin work on the 
textbooks that will be used dering the following year. They work 
on skills and terminology that has not been taught in the E«B, 
program. The idea is to (a) get them as far through the UISTAR 
program as possible, and (b) acquaint them with the conventions 
and skills that they will use during the followlrg year. 

Parentiil Role 

While a major concern of our program is on more effective teaqhing 
at school we are also very concerned with providing parents with 
skills important for their own futures and skills for teaching 
their children. The approach to parent change is the same as that 
for children. Teach them . Our program has been designed to 
involve parents in training at several levels. Parents can become 
teacher aides or assistant teachers. Parents can be taught testing 
for the continuous evaluation of the progress of the children. 
Parents can serve as family workers « Parents can be hired to serve 
as the video camera operators and data chiefs* For the parents not 
actively involved with the program at schools a training program 
provided through visitation by other parents is used to teach the 
parents about the program and to teach the parents how to actively 
support the learning progress of their children, 

As noted in I.B. (Scope) ^ the local PAC must decide to what degree 
and how oxir parent training progr^uns are to be used. 

We are firmly committed to support a parent cc»mnunity - LEA 
partnership in the operation of our program. The rationale for 
this is simple. Our goal is an improvement in the lives of disad- 
vantaged families. Unless the members of such families have the 
right to judge the effects of a program for themselves, we have no 
criterion of success nor guides to improving our efforts. We aerve 
in a community at the pleasure of the parents of the children 
involved in the program. 
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There arr five basl^'- roB;>A>nfcntB ^ .nur syt»tetn< 
A. ir.ctcase the inarro>'«J" cl*s-icow, 

2. Structure the daily pxogr.»T .o Insure that the teaching personnel 
have a clear pl.m v-f action, 

3. A teaching m<»thu<? tnat utilises basic cfthavioral principles to 
insure efficiency vn teaching, 

4. Continuing trains ig in the \is« of tho programs, and 

5. Continuous monitoring of the progress on the children and the 
sK.ills of the teachers and aides to be sure the system is 

f unctioninq . 

In previous uections vc aave described the classroom structure, pro- 
gran, and teachina in»^thod. What ren-ains to be describea in this 
section are the training methods used to get the programs into operation, 
the monitoring syste.ns to insure their continued effective use, and 
evaluation activities. 

A. Training Strategies 

The goal of training is to provide the teacher with the skills 
outlined earlier (i.F), ThAS i3 accomj>xishod in a two-week pre- 
service workshop, continuing inservlce sessions of about two hours 
a week, and through classroom supervision. A number of detailed 
proceaural manuaJs nave been prepared for trainers and participants 
in training. The icey is to know what the teacher should b-» able to 
do, and to devise procedures teach the required skills. It 
should ue recognized that precision in specifying and training 
essential teaching skills is only possible within a structured 
teaching system. 

The pieservice worjcshop focuses on teach i-ng the general require- 
ments tor teaching aiiy ta^K. This is accomplished through a 
variety of exercises that involve analyzing a task into its componanta 
and through deawnotracxon and practice with a variety of key tasks 
from eacn of the prcjrama, The use of signals, precise presentation 
of tasks, rem for cement, and corrections are emphasized. The pro- 
cedure is noc '.miit.e an actor learning a new role in a play. The 
participants work n^stiy in small gro'ips with a supervisor serving 
as a coach, checkouts for proficiency are required periodically 
throughout the workshop. Time is also devoted to planning classroom 
schedules and the use ot continuous testing for monitoring of progress 
and regrouping of u\e ci»xldrjn. 

A video tape Horary iiii.acrating how to qn^e kev tasks in the program 
is available for inservice training. «*hile the preservice training 
tocuses on o^naral tequirer'er.tc fot teaching and the key formats for 
the first iC- to 60 days of wiven prcxiram, inssT-vice training sessions 
focus mainly on preparing ^f^acners for new formats coming up in their 
progranvs. ''he procedure still basically the same: practice, 
critique, practice, checkout. The video tape library allows a 
teacher to pra'-tice new fo/aiats on her owr.. Video tapes of class- 
room teaching are also used in traininq. Some of these tapes are 
sent to tne sponsor for review and critique. 
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Another phase of inservice traininq involves a pi^ogxaxmed course 
111 benavior modification and the teaching principles underlying 
the models (Backer, Engelmann, and Thomas, 1971). This is con-* 
ducted on site and course credit is provided for this training 
through the University of Orefon. 

classroom supervision is provided by consultants trained by the 
sponsor. Many of these are former teachers from the local site* 
There is approximately one local supervisor for every two hundred 
children in the program. In inrorking with teachers (and aides of 
course) , the supervisor observes the performance and provides a 
critique. The supervisor may actually stop a teacher presentation 
and give a demonstration to the teacher using her group. Assign-* 
ments may be given on a specific skill to be checked out on the 
supervisor's next visit* 

Teacher supervisors are also required to make periodic video tapes 
of their supervision procedures which are reviewed by our project 

managers • 

The project manager assigned to each site is ultimately responsible 
for the training and implementation of the teachers and aides at 
that site. The project manager is responsible for: (a) the pre-* 
service training, (b) the inservice training, (c) identification of 
groups r teachers, or aides who are below performmce standards on 
specific formats, tracks, and tasks* The project manager uses: 
(a) continuous tests, (b) video tapes of teachers, aides and super- 
visors, and (c) error data on the worksheet performance of children 
to identify problems. 

The project manager gives assignments to the local teacher super*-* 
visors (supervisors who are hired by the district and who work on 
site*) The local supervisor has three primary training obligations: 
(1) conducting pre-service and inservice; (2) working in the class- 
rooms with teachers and aides (which activity consumes perhaps 80 
per cent of the supervisor's time) ^ (3) identifying and reporting 
on problems with the instructional matenals, problems with schedules # 
problems related to training of teachers and aides, and general 
problems of implementation (material not ordered, no teacher in a 
classroom , etc . ) « 
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B. Morittorin^ t^ ^ uij>ity Control ) ^ 

ne n v^AqemenL of r.h, . ro.jres8 oi in»>,-e tiM^i 10^ COO childran in 20 
locations around th^* country roquxren a carefully ciesigned monitoring 
systmi* Ai4 ouciiuo of our monitoring nyatem follows (insert diagram 
19A. Note tJjat won Ji Coring proceduree related to training were 
diaciiseed in the section in training 

!• Diagram of Monitoring System 

AT THE FOLLOW THROUGH SITE: 



Children Day in each program reported each two weeks 
in Bx-wecKly reports* Absences reported 
each two weeks. 

Continuous test scores are reported for one 
area in Bi-weekly reports* 

All children are tested each spring on the 
Sloasen Intelligtsnce Scale (to mi^asure language 
progress) and the Wide Range Achievement Te8t# 
and the Met repalifn Achisftwwtt T»et ^ 



Teachers & 
Aides 



Teachers and aides are supervised by local 
teacher supervisors and field consultants at 
frequent intervals^ and teacher performance 
forms are filled out and provided to teacihers, 
directors # and supervisors. 

video t^pes of teaching are sent to Oregon or 
to managers for evaluation at two times during 
the year. 



Follow 
Through 



Supervisors Supervisors are monitored by Follow Through 

Directors and Oregon Project Managers to insure 
they are spending an adequate amount of time 
in supervision and training. 



AT THE UNIVERSITY OF OREGON: 



r Project Managers 



Computer and Data Staff 
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r Program Directors 

1 Becker^ Enqelmann> Carnine 



Video Tajpe Analysis Crew 
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Bl-Weekly Reports and CoRtinuous Prograss T»sts 

Built into the DXSTAR pro<yr«K»s are teacher-^iven teats to check each 
new skill as it is tauqht. To monitor child progress Independently of 
the teacher, continuous progress tests are given in each area each six 
weeks by paraprofessionals at the Follow Through sites. Every two 
weeks test results in one area are sunooariced by child on four-copy IBM 
forms, (with names and numbers preprinted by group). These biweekly 
reports also show absences for the two-week -period and show where each 
group in in each progran. Copies of the reports go to the teacher, the 
supervisor, the Follow Through Director, and our data analysis center. 
The reports can be used locally to directly regroup the children or to 
provide special remediation or acceleration. They also provide a basis 
for sunnary analyses of progress for manag^nent by the sponsor. Trouble 
spots can be determined and worked on. 

The Arithmetic I Continuous Test will be used as an example for all of the 
tests. The test consists of several tracks which cover the major skills in 
the program. Examine the child record form on the next page. 

The abbreviations across the top of the form stand for the skills. 00 
stands for object counting; CTN stands for counting to a number. Along 
the left aide are lesson ranges. The first range is from 1 to 43, the 
others progress in 10 day intervals. According to a child's lesson day 
in program when he is tested, he fits within one of the lesson ranges. The 
lesson range will determine which skills will be tested and the sxpectsd 
scores (baseline) for each child. A child on day 100 in the program 
should pass test items 7, 15, 25 and 30. He should fall items of a higher 
number in the given tracks and pass those of a lower nusiber. Since each 
item is selected to reflect 10 days progress in the track, the scores are 
directly interpretable. For example, a child at program day 100 who passes 
only item 23 in track CPNTN (counting from a nundber to a number) is 20 
days behind where he should be in that track. He should pass item 25, 
but falls two items below. Each iton is worth 10 days. Similarly, a 
child who passes item 27 in the same track would be 20 days ahead of 
where he is placed in his group. TO make the continuous tests maximally 
useful to the teachers, keys are provided. The Cbntinuous Test Keys look 
like Record Form 2 but give the teacher precise information about where 
to find examples in DISTAR lessons of the skills that need remediation. 
For example, if a child fails item 25, the Key tells the teacher to go 
to Lesson 100, Task 1. For each test item there is an item specified in 
the program to show the teacher what skills need to be taught. With 
these procedures, diagnosis is immediate amS directly informative to 
the teacher. 

Management reports are produced by computer from the biweekly reports. 
These reports keep track of group gains in lesson days and on the Con- 
tinuous Progress Tests. Projections are made and compared with target 
goals for each group for the year. When projections fall behind goals 
adjustments in the program can be made at the site to atteq^ to reach 
goals before It is too late to do anything about it. Management reports 
also keep track of school calendars and absences so that it is possible 
to base projections for each site on local conditions that affect teaching 
days available. 
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9^0t*'' TI.M.STRATTVF RESLI.TS 



Sincv the tall of I i6a, five entetxn«|~lcsvel groups of children (called 
cohorts) have complf.tpd at lef ^^t one year of the program. Very little data 
were aachered on the 68-69 starting cohort and it iti not included in Fig- 
ures 5 thrv#uqh 9, althoiiqh wliat ^^esults ar« available are included in the 
averages presented in Figures 2 tc 4. 

The analyses to be Tiosented are based on children who entered the program 
at a beginning level, who averaged at least 130 days attendance per year, 
ami on whom there were at least two teste available for confuting gains 
scores. There were 9152 children available under these rules. Of these 
7168 (78%) came from homes defined by OBO guidelines aa poor. Since 
Follow Through was designed primarily to help the children from poor homes 
"make it" in school and life, we will focus our data presentation on the 
results for p-oor children only. When all children are included, the aver- 
aged crrade- level scores are about .1 to .2 grade levels higher (Becker and 
Engelmann, 1971) . The separate analyses of data for children who entered 
the proaram beyond the first year, or who were present for only one testing 
indicate that on the average these children are not as advanced in the in- 
structional programs and are somewhat behind on achievement tests. It should 
also be noted that children who were retained (about 7%) are included with 
their starting classmates. 

Mean Results by grade lievel Averaged Over Cohorts 

Figures ?, 3* and 4 show the mean qrade- level scores on the Wide Range 
Achievement Test (WRAT) in reading, arithmetic, and spellinq for poor chil- 
dren. In Figure i it can oe seen that poor children starting the program 
in kmderqarten leave third grade with an average reading level on the 
WHAT of 5.2 qr<ide55. The children have learned deooding skills well. Chil- 
dren starting the program in first qrade leave third grade with an average 
reading lev^l of 4.5 grades • It should be apparent that starting teaching 
earlier gives the K-starting children an advantage of .7 grade levels by 
♦:he end of third grade. 

Figures 3 and 4 sliow that in arithmetic and spelling, the K-starting 
poor chiMren m the program are near or above grade level, but seen to 
be loosinq ;ome ground. The Ist-starting children are a little below grade 
norm. As later figuxrs will show, an analysis of gains by cohorts shows 
that with successive waves of cbildrf*n wo are overeomxng this problem. 
The problem in arithmc^tic arose from our initial focus on reading. Arith- 
metic did not get ta.iaht a& much and was usually taught hy aides. Also, 
program revisions have been needed to accelerate the teaching process. 
In spelling, we have never offered a formal program, we have only taught 
the subject as a by-product of reading, in later cohorts it was necessary 
to encourage the teachers to more formally teach spelling. 

In ov^iluatincr thes^ overall fir'lina'5 with F'Oor children, the reader should 
koep in mind that the averaqe qaxn per year with such children has typi- 
cally been reported at •fi qrade levels. 
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rai ns -Scor e Ana iy hy ^"p^iort 

T^'iquros 1» throuah ft nlve i qa Ins-score analysis by cohort in reading 
and arifhmetir. . Spelling graphs have been omitted because the results 
are very close to those in arithmetic. Because of changes over time in 
testing practices and incomplete testing, we have examined qains scores 
on a year-tc-year basis. This allows us to greatly increase the N on 
which conclusions are drawn over that obtained when only children tested 
every year are included. 

The average gain per grade in reading was 1.44 grade levels for K- 
starting children and 1.52 grade levels for Ist-starting children. One 
can see in Figure 5 a clear trend toward an improvement in level of per* 
formance in later cohorts. The same trend is not appairent in Figure 6. 
At the end of third grade* Restarting poor children exceed national norms 
on the URAT by a whole grade level. 

The average gain per grade in arithmetic was 1.01 for K-startinq children 
and 1.03 for Ist-starting children. The Wide Range is not sensitive to 
our program effects at the second level, the test covers only 4 items 
at this level t mostly in formats the children have not been taught. 
Figures 7 and 8 show that K-atarting poor children reach grade levels by 
the end of third qrade while Ist-starting children fall short. This prob« 
I em is being overcome in later cohorts. We have introduced procedures to 
be sure more children get through the instructional program* Once this 
occurs , our evidence shows that they will test above grade level. 

IQ Gains 

Gains on cognitive measures are an expected outcome of the language concept 
of instruction and logical operations taught in the B-B pro9ram. Table 1 
sunmiarizes our current findings on IQ gains using the Slosson Intelligence 
Test with poor children only. For children in kindergarten programs # there 
is a strong gain during the kindergarten year. The average over four cohorts 
IS 9.6 10 points with an N of 1196. Beyond the kindergarten grade the gains 
appear to be minimal, but we must await future coR9>letions of the program 
before strong conclusions can be made. Note that with po:»r children there 
is typically reported a decline in mean IQ from kindergarten through third 
grade* 

The ip gain datv. for children starting in first grade are more consistent and 
based on larger samples. Except for cohort 1 the gains appear to be cumu* 
lative and substantial from first to third grade, averaging about 8.5 IQ 
points on 1000 to 1400 children. 

There are a number of reasons for believing that the IQ gains obtained so 
far represent little more than 30% to 40% of the potential of the present 
teaching system. Even so, they suggest an important and powerful gain 
(against a typical loss in comparison groups) in level of general cognitive 
functioning as one outcome of th^. Bngelmann^Becker Follow Through Model. 
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K-Startinq 



Ist-Starting 



Tabla 1 



IQ - Gain en th* Slosson 
Poor Chiidren Only 



Cohort 




Pre K-Po8t K 


Post K"-PO«t 1 


Post l-Po8t 2^ 


Post 2-Post 3 


u 


Basis 






6.2 
105.0 - 


(57)* 
111.3 


1.4 (125) 
107.8 - 109.3 


-3.3 (85) 
108.0 - 104.7 


1 


Gain 
Basis 


11.0 
105.3 


(52) 
- 116.3 


-.5 
108.1 - 


(482) 
107.6 


.3 (174) 
11U2 - 111.6 


-1.8 (71) 
116.8 - 115.0 


2 


Gain 


4.2 


(269) 


.3 


(381) 








Basis 


105.3 


- 109.5 


108.0 - 


109-3 






3 


Gain 
Basis 


6.7 
108.6 


(135) 
- 115.3 










4 


Gain 
Basis 


12.0 
101.6 


(740) 
- 113.6 










X 


Gain 


9.63 


(1196) 


1.28 


(920) 


.77 (299) 


-2.58 (156) 



Cinnilatlvo Cain Pro k - Post 3 ~ 9.1 points 



Retentions 



Cohort 




Pre l- 


Post 1 


Post 1 


-Pest 2 


Post 2 


-Post 3 


3rd 




C 


Gain 
Basis 


6.3 
86.6 


(62) 
- 93.0 


2.3 
95.5 


- 97.8 


1 .4 

98.7 


(479) 
- 100.2 


2.77 
85.9 - 


(39) 
88.7 


1 


Gain 
Banis 


-2.5 
98.9 


(185) 
- 96.4 


3.1 
97.0 


(773) 
- 100.1 


-.1 

100.1 


(696) 
- 100.0 


2.04 
83.3 - 


(53) 
85.3 


2 


Gain 
Basis 


3.5 
94.3 


(250) 
- 97.8 


1.4 

97.0 


(244) 
- 98.3 


2.8 
98.2 


(231) 
- 101.0 






3 


Gain 
Basis 


3.9 
97.3 


(51) 
- 101.8 


4.3 
99.4 


(42) 
- 103.6 










4 


Gain 
Basis 


8.7 

90.9 


(469) 
- 99.6 














X 


Gain 


5.02 


(1017) 


2.64 


(1432) 


1.89 


(1406) 


2.38 


(92) 



Cuaulative Gain Pre 1 - Post 3 — 8.55 points 



* N in parentlieses 
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Mm»n Parfor— nee on the MAT - Soring 1973 

Tables 2 and 3 shov the mean perforaance of the poox children in the "Gains 
Analysis" on the Metropolitan Achievewent Test (MAT) given in the Spring of 
1973. Expected grade noma at the time of testing would b€> 1.8, 2.8, and 3.8 
grades respectively for the average child. Our children in K-atarting sites 
are performing above grade level on this test at the end of first and second 
grade. At the end of third grade* our children perform close to an acceptable 
level (or above) on this test and onlall subtests except Reading . This mobtest 
requires the student to read a short stoy and then ansirer questions about it. 
Analysis shows that our children have difficulty with the nearly unrestricted 
adult vocabulary used in the MAT stories and questions. These children are 
still deficient in language concepts (not decoding skills), some of vfhich the 
"average" child has mastered. In general, our K-starting children did better 
on the MAT than we anticipated they would. 

The children from Ist-starting sites (Table 3) do reasonably well in math at all 
grade levels, but again fall behind in MAT Reading (comprehension) scores. A 
possible implication of these findings is that starting earlier (during the 
kindergarten year) with fosmal training in language concepts and logical opera- 
tions is likely to be beneficial to children from economically disadvantaged 
homes . 



MAT Grade Norm Scores; Spring 73 
E-B Follow Ihrough Model 

K Starting - Poor - Gains Analysis - Spring 1973 



Grade 
Cohort 



3 (Kr71) 2 (ICF70) 1 (KF69) 





Mean 


N 


Mean 


N 


Mean 


N 


Word Knowledge 


2. 


41 


(591) 


2.97 


(553) 


3.49 


(252) 


Word Analysis 


2. 


25 




3.11 


(571) 






Reading 


2. 


22 


(592) 


2.88 


(552) 


3.25 


(250) 


TOTAL READING 


2. 


28 


(507) 


2.92 


(544) 


3.33 


(250) 



language 
Epclling 



^0 4*^ 



4.21 (224) 
(MO) 3.7C (24G) 
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Math Comp. 




2.98 


(538) 


4.13 


(236) 


f4ath Concepts 


1.99 (591) 


2.89 


(570) 


3.86 


(236) 


Math Problems 




3.06 


(542) 


3.68 


(237) 


TOTAL HATH 


1.99 (591) 


2.83 


(560) 


3.86 


(234) 
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Metropolitan Achievenent Teat 
Grade Norm Scores 
E-B Follow Through Model 

lst-startin9 - Poor - Gains - Spring 1973 

Primary 1 Primary 2 Elementary 



Grade 
Cohort 



Word Knowledge 
Word Analysis 
Reading 
TOTAL READING 



1 

4 (1P72) 

Mean N 



2 3 
3 {1F71) 2 (1F70) 

riean *^ tJean 



Language 



1.88 (372) 2.00 (365) 3.03 (557) 

1.90 (371) 2.69 (365) 

1.68 (371) 2.49 (362) 2.8G (557) 

1.78 (370) 2.53 (362) 2.91 (555) 



4.07 (513) 



Spelling 






3.01 


(323) 


3.3? 


(530) 


Math Corop. 






2.84 


(336) 


3.99 


(557) 


Math Concepts 


1.67 


(372) 


2.50 


(362) 


3.47 


(552) 


Math Problems 






2.71 


(337) 


3.50 


(554) 


TOTAL MATH 


1.67 


'372/ 


2.54 


(360) 


3.61 


(550) 
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Prellttlnary studies of Teaching Process within the System 
Training and Supervision 

Wfe believe training and supervision to be most critical components of our 
program. The functional role of training and supervision needs to be cri^ 
tically investigated. For various reasons we have not been able to experi* 
wAnt in the field with these variables. Our site? do not like research 
which might withhold services fzom their children, nor do we. We were 
able to pilot one supervision study tJiis pa^i year (Carnine, 1973) . Pour 
teachers in Eugene were given after school training in the use of DISTAR 
Reading^ using procedures like those we use in the field. The students of 
these teacheni were qlvren a criterion-referenced test covering a 20'sJay 
period of training* Then the teachers received in-class supervision similar 
to that used in Poilcw Through. After 6 weeks the children of all five 
teachers were tested on material from the preceding 20 days of instruction. 
The children gained significantly in accuracy {4S% to 65%) when their teachers 
received supervision in classroom procedures,. 

Teacher Performance and Correlational study of Child Outcomaa 

We have tried a variety of procedures to get directly coded measures of 
teacher performance from video tapes which will correlate with gains on 
continuous tests for the children* For the most part, working with tapes 
sent in from the field, this effort has not been successful* Attempts to 
establish controls by havincr each teacher taped with a middle group and a 
low group, and by restricting the taping to common tasks in one subject area^ 
were thwarted by different task lengths in various parts of the program, 
restricted samples of teacher behavior, unknown child entry behaviors » and 
defective tapings. Because of the high cost of analysing even two lO^minute 
t^ape segments, we have stopped this work until it can be carried out under more 
controlXed^conditions • 

The procedures we have used to obtain reliable data from video tapes of small 
aroup instruction may be of interest, since the teachers are expected to 
follow program forma ts» the first requirement is that the raters know the 
correct execution of the fon^ats, including correction formats. Because a 
teacher cat^ run off a number of laska in one minute, coordinating the ob- 
servations of two raters takes some doing ♦ We finally rhievcd this coor- 
dination by dubbing a blip to indicate the baginninq cf a task, defined as 
a teacher presenration and a required grou-p response* For each task segment, 
we rate the following variables Hf^ ^re^t^ly for initxnl tasks and correction 
tasks ; 

Format ; Th^ teacher correctly followed the format prescribed by the 
program, or she did not .F-*-, K-) . 

Group Response t All members of the 9x00^. ar»??wered correctly, at the 
same rime, or they did not ^'K^ * -> . 

Teacher Reaction g 

a. ^raise given when R-*^ IK^/f) . 

b. Praise given when R-- (R-'/Vi. 

c. Correction made when R-«- (RVC). 
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d. cswrection aads when R- <Rr/C) • 

«. Coes or. to next taslt • , 

f. Ck>es osk tc next t«sic when (Rr,T). 

MSI fflPlAVAaMI^ 

The "good" teacher sftould use correct formats {F^H^h^kW afiov, 

a hiqh percentatie of reactions «, d, and o ahove. «fe aXao believe that 
fast pacinq of the task is VBty**critical. buc have not. yet obtaiiiwd a 
r«XiabX« ««»»Rure of tasks taught per mimtte whi'-.-h is ad juste*; for task 
length, witlt an s ranging €ro» 14 to ?4 50-mtaute tapes. th« two-rater 
percentage agri^ements were bot%*een 60-69 for 0 variables, 70-79 for I var- 
iable and 80 or above for 12 variablefc. rocr t^rc quality contributes to 
tBuch of the unreliability. 

Ten-iRinute ti^s on ? groufKS of Level 1 instruction in reading and 9 grouftt 
of Level 2 institetlon wer«» analyzed. The teachers had been rated by super- 
visors as being high middle (2> or low (1) in teaching skills. Child 
qain was neasured by days gained on the continuous tents for reading during 
that school year, adjusted for the number of school days between first and 
last testing, hn averac^ test gai.n was coaputed for all children in a group. 
The results from this nt»fl*f suggest the fo.t lowing; 

1. the more often a group shows an lOOi correct response the higher 
the test-days gained. The correlation is about .60. This could be more of 
a function of child behavior than teacher behavior, and is therefore not 
interpretable without better controls. It could mean, however, that the 
better teacher gets her children rerforraing to criterion atid keeps them 
there. 

2. Individual teacher pe'^rmance measures did not predict cJiild teat gains, 
nor did an a«gr«^«te of teacher performance measures (excluaing per cent of 

3. An aggregate of teacher performance measures (sum of percentages for each 
laeasure. taking into account a -good" and "bad" direction, and excluding 

per cent R+> correlated .54 wttt supervisor's ratings of teacher performance. 

This is just a very crude beglnninci sugfsstinQ titat there may be ways to 
measure teacher aerfotwance within th« smsl) -group-teaching phase our 
system which will relate to cutc-xne data. We a-.e r:urr«ntlY Into 9 study 
examining rating® by two «up<:ri.l3or!i cn awre th.en 2'>'> us^checs ani aides 
in our Follow Throjgn sites which we hope wiU onable us to ex^uaine teacher 
l-Rplementstion of program and ln«.tructiwnal !,kill* !.n relation to child 
outcomer. If this analysis orovei frjJtful, we flan to cet a n«w group of 
video taptts on exceilerv and poor ceachcrs (defined by ratlmisi and then 
examine Ivger sampliss of their behavior using video tapefc. 

gicperJ.g w*nta I Stud ies of lefccher Pvrtormanyt. 

use of sianalst A standard ?vart of the fcrmat for small group instruction 
is to u#e signals to qet attentic* i-ie tc net tlie children to resrond 
together. sev*»r«l studies ha/e been carti I cut. to exai'.in« the tonctional 
effects of signals on ^ttenatnT, respcHlng. and following thm load of 
another child. Thft .trst stud/ 'rowar-, Carnvr.e, ^nd *?eckpr, 19/3) intro- 
duced signals 'nto two regular s#.^nd-grao« claRsrtWM for l**r<Te group 
instruction r25-'30 ciiildren^ in arithmetic. AS » dc<iign w^s ii-*rd with 
individual observation being made on 8 childrrr in one clas and 9 In the 
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other. The children were given daily practice in two kinds of arithmetic 
problems, in the A condition the teacher did not give the children any 
specific signal in response to her question beyond the question itself. 
In the B condition, the teacher gave a specific signal, a nonaudible hand 
signal, following the question. 

The analysis showed good reliability in measuring the dependent variables 
and indicated that the use of signals in both classes clearly increased 
attending, increased responding, and reduced the amount of following the 
lead of other children. 

A second signals study (Oowart, Carnine, and Becker, 1973) was carried out 
during small group DISTAR instruction with a group of first graders who had 
had 6 months of DtSTAR instruction. An ABA design, where the A condition 
used signals and the B condition did not, showed that lack of signals in- 
creased following, but with this experienced group dropping the signals did 
not decrease attending or responding. There were two problems with this 
study in terms of demons tratina the functional properties of signals, with 
experienced subjects, the signal may no longer be necessary to get the children 
to attend and respond. There may be enough conditioned reinforcers operating 
in the setting to keep behavior going without signals. A study using in- 
experienced students in small group instruction is underway to clarify this 
question. Secondly, it was observed that when signals %rere dropped, the 
teacher picked up the pacing of her tasks. There were shorter pauses be- 
tween the tasks, and more tasks presented per minute. In the planned study, 
task pacing will be controlled. 

Pacing 

For several studies, pacing was defined as the interval bet%«aen the children's 
response ending one task and the start of the next, with one group of inex- 
perienced preschoolers working in a group with minimom social reinforcement, 
the shift from a 2.5 second pause between tasks to a 5 second pause was 
enough to completely disrupt the group and halt the experiment. In a sub- 
sequent study, first grade children experienced in DISTAR instruction 
were studied under conditions where normal teacher social reinforcement was 
provided. When the between-interval during reading was increased from 
1.9 to 3..^ seconds on the average, attending and responding decreased for 
four days and then returned to their previous level. With the same children 
during Arithmetic, the between-task interval was moved from 2.0 to 4.7 
seconds on the average. During this period the teacher also looked at the 
blackboard. Attending and responding during task decreased rapidly. When 
social reinforcement was provided again between tasks, but the long interval 
maintained, most of attending and responding during task returned. Thus, 
given a normal teacher-child supportive interaction, a slow pacing of tasks 
in this sense does not appear to be detrimental. 

In another study, pacincv was defined as the number of tasks conqpleted per 
minute. In an AB design, it was found with a top group of students that, 
increasing the tasks per minute increased attending and responding, but 
did not affect accuracy of responding on a test given after each lesson 
(Oowart and Carnine, 1973) . 
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Corrections 

Several studies have been attempted to study the functional effects of 
different kinds of correction procedures on the rate of acquisition 
of a set off symbol identification (letters-sounds) probiews. as yet no 
clecT differences among procedures have been founa. We are still trying 
to iearn to deal with this kind of study. Two studies are now xn progress. 

Pro^raiBiiing Strategies 

Carnine has shown that when teaching a set of tasks showing some conroon 
properties, learning of the set is more rapid (and errors feve**) if the 
tasKs more likely to be confused with oach other are separated by easier 
to differentiate tasks. Carnine has also provided evidence to show better 
concept learning wher- the set of tasks presented could not be responded to 
correctly by fixing on an irrelevant characteristic, and where all rele- 
vant characteristics had to be identified. Finally, Carnine has provided 
evidence to show that pres^ntino pairs of concept instances (geometric forms) 
which differed in only one characteristic (therefore isolating a characteristic 
as relevant or irrelevant) led to faj»te>; learning than if tho program involved 
pre«»Gntation of random pairs. 
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